The Prospects For Eye-Controlled Musical Performance

نویسنده

  • Anthony J. Hornof
چکیده

Although new sensor devices and data streams are increasingly used for musical expression, and although eye-tracking devices have become increasingly cost-effective and prevalent in research and as a means of communication for people with severe motor impairments, eye-controlled musical expression nonetheless remains somewhat elusive and minimally explored. This paper (a) identifies a number of fundamental human eye movement capabilities and constraints which determine in part what can and cannot be musically expressed with eye movements, (b) reviews prior work on eye-controlled musical expression, and (c) analyzes and provides a taxonomy of what has been done, and what will need to be addressed in future eye-controlled musical instruments. The fundamental human constraints and processes that govern eye movements create a challenge for eye-controlled music in that the instrument needs to be designed to motivate or at least permit specific unique visual goals, each of which when accomplished must then be mapped, using the eye tracker and some sort of sound generator, to different musical outcomes. The control of the musical instrument is less direct than if it were played with muscles that can be controlled in a more direct manner, such as the muscles in the hands.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

EyeMusic: Real-Time Eye-Controlled Multimedia Performance

A novel opportunity to transform eye movements into useful knowledge is to use the eye movement data to perform musical and multimedia compositions. Eye-controlled performance interfaces require new multimediabased communication, such as between between eye tracking devices and multimedia authoring environments. This paper presents EyeMusic, an integrated environment for developing eye-controll...

متن کامل

Bringing to Life the Musical Properties of the Eyes

Art, music, and science come together as computer musicians and computer scientists collaborate to create EyeMusic, a system for composing and performing eyecontrolled musical and multimedia compositions. In EyeMusic, an eye-tracking device communicates with a musical and multimedia authoring environment to enable composers and artists to sonify and visualize eye movement data. During a live pe...

متن کامل

Problems and Prospects for Intimate Musical Control of Computers

In this paper we describe our efforts towards the development of live performance computer-based musical instrumentation. Our design criteria include initial ease of use coupled with a long term potential for virtuosity, minimal and low variance latency, and clear and simple strategies for programming the relationship between gesture and musical result. We present custom controllers and unique ...

متن کامل

Interacting with 3D Reactive Widgets for Musical Performance

While virtual reality and 3D interaction open new prospects for musical performance, existing immersive virtual instruments are often limited to single process instruments or musical navigation tools. We believe that immersive virtual environments may be used to design expressive and efficient multi-process instruments. In this paper we present the 3D reactive widgets. These graphical elements ...

متن کامل

EyeMusic: Making Music with the Eyes

Though musical performers routinely use eye movements to communicate with each other during musical performances, very few performers or composers have used eye tracking devices to direct musical compositions and performances. EyeMusic is a system that uses eye movements as an input to electronic music compositions. The eye movements can directly control the music, or the music can respond to t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014